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(54) Diagnosis system, diagnosis data producing method, information processing device, 
terminal device and recording medium used In the diagnosis data producing method 



(57) A diagnosis system includes a temninal T and pares the received image data with reference data of 

a server S which are connected to each other through the server S and automatically diagnoses the user's 

a network B. A user innages a given position of user's health condition, to thereby produce diagnosis data. The 

body by an imaging device C connected to the terminal diagnosis data is equivalent to a diagnosis result whom 

T and transmits image data obtained, by that imaging to a doctor says a patient, to thereby realize an automatic 

the server S through the networlc. The server S com- diagnosis. 
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Ooscrtptlon 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

[0001 ] The present Invention relates to a technique by 
which a diagnosis such as a depression diagnosis, an 
insomnia diagnosis or a drooping eyelid diagnosis is au- 
tomatically conducted by using a computer. 

2. Description of the Related Art 

[0002] it is general that the diagnosis or medical treat- 
ment of a disease is conducted by a doctor. Also, it Is 
general that a patient or a person to be diagnosed di- 
rectly visits a medical doctor and faces the doctor to con- 
duct the diagnosis and the medical treatment. 
[0003] On the other hand, with an development in an 
infrastructure in recent years, a terminal is connected to 
a network such as an internet by even a general home 
or personal unit, thereby being capable of getting vari- 
ous information. 

[0004] With the progress of the above technique, a 
technique In which a doctor and a patient whose termi- 
nals are connected to each other through the intemet 
exchange voices and images at a real time, to thereby 
conduct a diagnosis and a medical treatment has been 
put in a practical use. 

[0005] Incidentally, there are a diagnosis which is not 
80 difficult and a medical treatment such as the st^in as- 
pect diagnosis that does not seriously affect the body or 
the life among the diagnoses and the medical treat- 
ments. 

[0006] In the recent years where the life level has 
been Improved, a demand for such slight diagnosis or 
medical treatment is extremely increased, and there ex- 
ist many users who thinic to obtain the supply of the di- 
agnosis or the medical treatment method related to the 
slight diagnosis or medical treatment without facing the 
medical doctor. 

[0007] However, In the above-described technique 
that attaches importance to the real time property, al- 
though there is advantageous In that an accuracy In the 
diagnosis and the medical treatment Is high, there Is In- 
convenient in that the medical doctor and the patient 
must employ their temninals on time. Also, since the 
judgment of the diagnosis and the medical treatment is 
finally conducted by the doctor, there arises such a se* 
rious problem that the doctor must be ensured, and the 
above technique is unsuitable for the minor diagnosis 
or medical treatment. 

SUMMARY OF THE INVENTION 

[0008] The present invention has been made to solve 
the above problem, and therefore an object of the 
present invention is to provide a diagnosis and medical 



treatment technique to which a network is applied where 
everybody can be subjected to a desired diagnosis and 
medical treatment at a desired time without requiring a 
medical doctor in principle. 

9 [0009] in order to achieve the above object, according 
to the present invention, there is provided a diagnosis 
system, comprising: a terminal device that receives im- 
age data obtained by imaging from a given imaging 
means that repeatedly images a position to be imaged 

10 which is located at a given position of a user's body; and 
an information processing device which is connectable 
to said terminal device through a network; wherein bM 
terminal device includes a transmitting means for trens- 
mitting the image data produced by imaging the position 

IS to be imaged by said imaging means to said Inf onmation 
processing device through said network; wherein said 
image processing devtee includes a diagnosing means 
that conducts a given diagnosis on the basis of image 
data received from said tennlnal and produces diagno- 

20 sis data pertaining to a diagnosis result; and wherein 
said infonnation processing device produces the diag- 
nosis data in a time series manner on the basis of a plu- 
rality of image data produced by imaging the position to 
be imaged at given time Intervals. 

25 [0010] in this diagnosis system, the information 
processing device automatically conducts the diagnosis 
based on the image information transmitted from a us- 
er's terminal by the user. Therefore, according to this 
diagnosis system, the diagnosis is conducted without 

30 troubling the doctor. As a result, the user is not required 
to set a time with the doctor and is easily diagnosed 
whenever and wherever. 

[001 1] Also, in this diagnosis system, a plurality of im- 
age data is produced at the same imaging position by 

3S repeatedly imaging a given position to be imaged in a 
user's body, and the image processing device that has 
received the image data produces the diagnosis data 
with respect to the respective image data. This corre- 
sponds to the actual diagnosis in which a given position 

40 of the user is fixed-point observed to follow its develop- 
ment. That Is, according to the present invention, since 
the given position to be imaged is obsen^ed at given time 
intervals, the diagnosis high in the precision Is conduct- 
ed white being simple. The diagnosis data Is produced 

45 In accordance with the time series on the basis of the 
received Image data. The diagnoais data may be pro- 
duced on the basis of ail of Uie receh/ed image data or 
may be produced on the basis of only the required image 
data. 

so [001 2] For example, if the above-described diagnosis 
data is returned to the user, the use can apply the diag- 
nosis data to the user's health management. For exanv 
pie, a medicine or cosmetics which is judged to be re- 
quired on the basis of the diagnosis data can be pur- 

55 chased by the user. 

[0013] Also, the diagnosis data can be utilized by the 
manufacturere or tiie disU'ibutors of the medicine, the 
cosmetics, medical apparatuses or beauty implements. 
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For example. If the diagnosis data is sent to the distrib- 
utors of the medicine or the cosmetics, the diagnosis 
data can be utilized by the distributors, for example, a 
system can be constructed in which the medicine or the 
cosmetics are delivered from the distributor that has re- 
ceived the diagnosis data automatically or in response 
to B purchase request from the user In this case, the 
user needs to make some contract with a person who 
manages the information processing device, and with 
such a contract, tf the user conducts a simple process 
for photographing and transmitting given image data at 
home, the user can get the medidne, the cosmetics, 
medical apparatuses or beauty implements which meet 
the user's health condition while being at home. 
[001 4] In the present specification , the image includes 
not only a static image but also a moving image. 
[0015] In the system, the Image data is transmitted 
from the Infomnatlon processing device from the user's 
terminal, but the oral consultation data related to the di- 
agnosis contents and including given character Infonma* 
tion may be also transmitted to the Information process- 
ing device. The oral consultation data may Include, tor 
example, infbnnation on the age and sex of the user and 
information on the life environments of the user The in- 
formation that cannot be included in the image data is 
included in the oral consultation data, thereby being ca- 
pable of enhancing a precision In the diagnosis. 
[0016] In the present specification, the character in- 
formation includes the information on marks used for ex- 
pressing the infomiation related to the diagnosis con- 
tents in addition to general character Infonnation such 
as text data. For example, the information produced by 
selecting one from a plurality of options is called "char- 
acter infonnation' in the present specification. 
[001 7] In this case, the infonnation processing device 
produces the diagnosis data taking not only the image 
data but also the oral consultation data into considera- 
tion. 

[0016] In the above tnfomiation processing devk^, 
not only the diagnosis data is produced, but also pre- 
scription data related to the prescription that meets the 
diagnosis result may be produced on the basis of the 
diagnosis data. In this case, the prescription data ac- 
cording to the time series Is produced on the basis of 
the diagnosis data produced according to the time se- 
ries. With this operation, a series of worics including the 
diagnosis and the prescription which are mads by the 
doctor can be automated. The prescription data Is avail- 
able to the user, or the manufacturers and the distribu- 
tors of the medicine, the cosmetics, medical apparatus- 
es or beauty implements as in the above-described di- 
agnosis data. 

[001 0] A terminal device that constitutes a part of the 
above system In accordance with the present Invention 
is as follows. 

[0020] That is. there is provided a tenninal device 
whteh is connecteble through a network to an image 
processing device having a diagnosing means that con- 



ducts a gh^en diagnosis on the basis of image data re- 
ceived through the network to produce diagnosis data 
pertaining to a diagnosis result, said temiinal device 
comprising: a transmitting means that receives, from a 

s given imaging means that repeatedly images a position 
to be imaged whk:h is located at a given position of a 
user' s body, the image data produced by imaging the 
position to be imaged with the use of said imaging 
means by the user to transmit the image data to the in- 

10 formation processing device through said network. 
[0021] Also.the terminal device is designed as follows 
in the case where an intention is made to use the above- 
described oral consultation data. 
[0022] That is, there is provided a tenninai devk^ 

'5 which is connectabie through a network to an infomna- 
tlon prDcessing device having a diagnosing means for 
conducting a given diagnosis on the basis of image data 
and oral consultation data pertaining to the diagnosis 
contents and Including given character infonnation 

^ which are received through the network to produce di- 
agnosis data pertaining to a diagnosis result, said ter- 
minal device comprising: a transmitting means that re- 
ceives, from a given imaging means that repeatedly im- 
ages a position to be Imaged which is located at a given 

2S position of a user' s body, the Image data produced by 
imaging the position to be imaged with the use of said 
imaging means by the user and the diagnosis data and 
transmits the image data and the diagnosis data to the 
information processing devk:e through said network. 

30 [0023] Also, a terminal device that constitutes the net- 
wori( according to the present invention can execute the 
following method. 

[0024] That Is, there Is provided a method of transmit- 
ting diagnosis Information which is executed by a termi- 

35 nal device that is connectabie through a networic to an 
information processing device having a diagnosing 
means that conducts a given diagnosis on the basis of 
image data received through the network to produce di- 
agnosis data pertaining to a diagnosis result, said meth- 

^0 od comprising the steps of: receh^ing image data pro- 
duced, from a given imaging means that repeatedly Im- 
ages a position to be Imaged which is located at a given 
position of a user's body, the Image data produced by 
imaging the position to be Imaged with the use of said 

44 imaging means by the user; and transmitting the image 
data to the infonnation processing device through the. 
network. 

[0025] Also, the tenninai device that constitutes the 
network according to the present invention can execute 
so the following method in the case where an intention Is 
made to also use the above-described oral consultation 
data. 

[0026] That is, there Is provided a method of transmit- 
ting diagnosis Infonnatton which Is executed by a terml- 
S3 nal device which Is connectabie through a networic to an 
infonnation processing device having a diagnosing 
means for conducting a given diagnosis on the basis of 
image data and oral consultation data pertaining to the 
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diagnosis contents and including given character infor- 
mation wtiich are recelvad through the network to pro- 
duce diagnosis data pertaining to a diagnosis result, 
said method comprising the steps of: receiving image 
data produced, from a given imaging means that repeat- 
edly images a position to be imaged which Is located at 
a given position of a user's body, the image data pro- 
duced by imaging the position to be imaged with the use 
of said imaging means by the user and the diagnosis 
data; and transmitting the image data and the diagnosis 
data to the infonnation processing device through the 
network. 

[0027] Also, the temninal device and the method of 
transmitting the diagnosis information can be readily re- 
alized by using a home computer, a computer only for 
a game having a communicating means, or the like by 
allowing the following program recorded in a given re- 
cording medium to be read In the computer. 
[0026] The above recording medium is exemplified 
below. 

[0029] That is, there is provided a recording medium 
that records, in a computer readable manner, a program 
for allowing a temiinal device with a computer which Is 
connectable through a network to an Information 
processing device having a diagnosing means that con- 
ducts a given diagnosis on the basis of image data re- 
ceived through the network to produce diagnosis data 
pertaining to a diagnosis result to function as a transmit- 
ting device, said computer executing said program com- 
prising the steps of: receiving data produced, from a giv- 
en imaging means that repeatedly images a position to 
be imaged which is located at a ghren position of a user's 
body, the image data produced by Imaging the position 
to be imaged with the use of said imaging means by the 
user; and transmitting the image data to the information 
processing device through the network. 
[0030] Also, In the case where the network according 
to the present invention is intended to also use the 
above-described oral consultation data, the recording 
medium can be structured as follows. 
[0031] That Is, there is provMed a recording medium 
that records, in a computer readable manner, a program 
for allowing a temninal device with a computer which is 
connectable through a network to an Information 
processing device having a diagnosing means for con- 
ducting a given diagnosis on the basis of image data 
and oral consultation data pertaining to the diagnosis 
contents and including given character infonnation 
which are received through the network to produce di- 
agnosis data pertaining to a diagnosis result to function 
as a transmitting device, said computer executing said 
program comprising the steps of: receiving image data 
produced, from a given Imaging means that repeatedly 
images a position to be Imaged which Is located at a 
given position of a user's body, the image data produced 
by imaging the position to be Imaged with the use of said 
imaging means by the user and the diagnosis data; and 
transmitting the image data and the diagnosis data to 



the Information processing devtca through the network. 
[0032] On the other hand, the information processing 
device that constitutes a part of the above system ac- 
cording to the present invents n is stated below. 

5 [0033] That is, there is provided an infomnation 
processing device that is connectable through a networic 
to a temninal device having a transmming means that 
receives, from a given imaging means that repeatedly 
images a position to be imaged which is located at a 

10 given positk)n of a user* s body, the image data produced 
by imaging the position to be imaged with the use of sM 
imaging means by the user to transmit the image data 
through said networtc, sakH infomiation processing de- 
vice conrprising: wherein said image processing device 

IS includes a diagnosing means that conducts a given di- 
agnosis on the basis of image data received from said 
temiinal and produces diagnosis data pertaining to a di- 
agnosis result; and wherein said information processing 
device produces the diagnosis data in a time series 

^ manner on the basis of a plurality of image data pro- 
duced by imaging the position to be imaged at given time 
intervals. 

[0O34] In the case where an intention is made to also 

use the above-described oral consultation data, the In- 
^5 fomiation processing device is structured, for example, 
as foibws. 

[0035] That is, there Is provMed An Information 
processing device which is connectable through a net- 
work to a terminal device having a transmitting means 

30 that receives, from a given imaging means that repeat- 
edly images a position to be imaged which is tocated at 
a given position of a user* s body. Image data produced 
by imaging the position to be imaged by the user and 
oral consultation data pertaining to the diagnosis con- 

35 tents and including given character infomiation and 
transmits the image data and the diagnosis data through 
said network, said information processing device com- 
prising: a diagnosing means that conducts a given diag- 
nosis on the basis of the image data and the oral con- 

^ 8 u Itatio n data received from said terminal and produces 
diagnosis data pertaining to a diagnosis result; wherein 
said information processing device produces the diag- 
nosis data in a time series manner on the basis of a plu- 
rality of image data and oral consultation data produced 

^ by imaging the position to be imaged at given time in- 
tervals. 

[0036] Also, in the case where the information 
processing device also produces the above-described 
prescription data, the infonnation processing device is 
so structured as follows. That is. there is provided the in- 
formation processing device further comprising a pre- 
scribing means for producing prescription data pertain- 
ing to a prescription suitable for the diagnosis result; 
wherein said prescribing means produces the prescrip- 
ts tlon data in accordance with the time series on the basis 
of the diagnosis data produced in accordance with the 
time series. 

[0037] Both of the above infomiatbn processing de- 
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vices can be structured, for example, as follows: That 
Is, there is provided the informatton processing device 
wherein said diagnosing means comprises: an image 
processing means for conducting a given image proc- 
ess on the image data to produce comparison Image s 
data if occasion demands; reference data recording 
means for recording reference data for diagnosis; and 
a judging means for comparing the comparison image 
data with the reference data to conduct the gh/en diag- 
nosis. 

[0038] In the case where an intention is made to also 
use the above-described oral consultation data, the di- 
agnosing means of the information processing device 
comprises an image processing means for conducting 
a given Image process on the Image data to produce 
comparison imago data; reference data recording 
means for recording reference data for diagnosis; and 
a Judging means for comparing the comparison image 
data and the oral consultation data with the reference 
data to conduct the given diagnosis. 
[0039] The reference data includes data necessary 
for conducting plural kinds of diagnoses. In this case. If 
correspondence infomnation indicative of which diagno- 
sis the image corresponds to is added to the Image data, 
said Judging means can be designed to conduct the plu- 
ral kinds of diagnoses indicated by the correspondence 
infomiation on the basis of the correspondence infonma- 
tion received together with the image data. With this ar- 
rangement, plural kinds of diagnoses can be accurately 
executed by one system. 

[0040] Also, the reference data may include data for 
conducting at least one of a depression diagnosis, an 
Insomnia diagnosis, a drooping eyelid diagnosis, an au- 
tonomic imbalance diagnosis, a skin aspect diagnosis 
and a hair diagnosis. Then, said judging means con- 
ducts at least one of. the depression diagnosis, the in- 
somnia diagnosis, the drooping eyelid diagnosis, the au- 
tonomic imbalance diagnosis, the skin aspect diagnosis 
and the hair diagnosis indcated by the correspondence 
information. 

[0041] In this structure, 

[0042] Also, oonrespondence Infonmatioh Indicative of 
which diagnosis the Image corresponds to is added to 
the Image data, and said Judging means may conduct 
any one of the depression diagnosis, the insomnia di- 
agnosis, the drooping eyelk^ diagnosis, the autonomic 
imbalance diagnosis, the skin aspect diagnosis and the 
hair diagnosis indicated by the correspondence infor- 
mation on the basis of the correspondence information 
received together with the image data. 
[0043] The Information processing device that consti- 
tutes the network according to the present Invention can 
be executed by the following method. 
[0O44] That is, there Is provided a method of produc- 
ing diagnosis data which is executed by an Information 
processing device whteh is connectable through a net- 
wot^ to a terminal device having a transmitting means 
that receives, from a given imaging means that repeat- 



edly images a position to be imaged whk:h Is located at 
a given position of a user' s body, the image data pro- 
duced by imaging the position to be imaged by the user 
to transmit the image data through sakj network, sakl 
method comprising: receiving the image data from said 
terminal; and conducting a given diagnosis on the basis 
of the image data to produce the diagnosis data pertain- 
ing to the diagnosis result on the basis of the diagnosis 
result; wherein said receiving step and said conducting 
step are repeatedly conducted on a plurality of image 
data produced by imaging the position to be imaged at 
given time intervals by the userto produce the diagnosis 
data in accordance with the time series. 
[0045] in the case where an intention is made to also 
use the above-described oral consultation data, the in- 
fomiation processing device that constitutes the net- 
work according to the present Invention can be executed 
by the following method. 

[0046] That is, there is provided a method of produc- 
ing diagnosis data which is executed by an Information 
processing device which is connectable through a net- 
work to a temiilnal device having a transmitting means 
that receives, from a given imaging means that repeat- 
edly images a position to be imaged which Is located at 
a given position of a user' s body, the image data pro- 
duced by imaging the position to be imaged by the user 
and oral consultation data pertaining to the diagnosis 
contents and including given character information to 
U^ansmit the image data and the oral consultation data 
through said networic, said method comprising: receiv- 
ing the image data and the oral consultation data from 
said temiinal; and conducting a given diagnosis on the 
basis of the image data and the oral consultation data 
to produce the diagnosis data pertaining to the diagno- 
sis result on the basis of the diagnosis result; wherein 
said raceiving step and said conducting step are repeat- 
edly conducted on a plurality of image data produced by 
imaging the position to be imaged at given time intervals 
and the oral consultation data by the user to produce 
the diagnosis data in accordance with the time series. 
[0047] The information processing device and the 
method of producing the diagnosis data can be readily 
realized by using a general-purpose computer such as 
a home computer by allowing the following program re- 
corded In a given recording medium to be read in the 
computer 

[0046] That is, there is provided a recording medium 
that records, in a computer readable manner, a program 
for allowing an information processing device with a 
computer which is connectable through a networic to a 
tenfninal devk:e having a transmitting means that re- 
ceives, from B given imaging means that repeatedly im- 
ages a position to be imaged which is located at a given 
position of a user* s body, the Image data produced by 
imaging the position to be Imaged with the use of said 
imaging means by the user to transmit the image data 
through said networic to function as a diagnosis data pro- 
ducing device, said computer executing sakJ program 
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comprising the steps of: receiving the image data from 
said terminal; and conducting a given diagnosis on the 
basis of the image data and the oral consultation data 
to produce the diagnosis data pertaining to the diagno- 
sis result; wherein said receiving step and said conduct- 
ing step are repeatedly conducted on a plurality of image 
data produced by imaging the position to be Imaged at 
given time inten/ais to produce the plurality of diagnosis 
data in accordance with the time series. 
[0049] Also, in the internet according to the present 
invention, in the case where an intention is made to also 
use the above-described oral consultation data, the re- 
cording medium is structured, for example, as follows: 
[0050] That is, there is provided a recording medium 
that records, in a computer readable manner, a program 
for allowing an infonnation processing device with a 
computer which is connectable through a network to a 
terminal device having a transmitting means that re- 
ceh^es. from a given Imaging means that repeatedly im- 
ages a position to be imaged which is located at a given 
position of a user' s body, the image data produced by 
imaging the position to be imaged with the use of said 
imaging means by the user and oral consultation data 
pertaining to the diagnosis contents and including given 
character infomiatlon to transmit the image data through 
said network to function as a diagnosis data producing 
device, said computer executing said program compris- 
ing the steps of: receiving the image data cmd the oral 
cortsultation data from said terminal; and conducting a 
given diagnosis on the basis of the image data and the 
oral consultation data to produce the diagnosis data per- 
taining to the diagnosis result; wherein said receiving 
step and said conducting step are repeatedly conducted 
on a plurality of image data produced by imaging the 
position to be imaged at given time intervals and the oral 
consultation data to produce the plurality of diagnosis 
data in accordance with the time series. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[00S1] These and other objects and advantages of 
this invention will become more fully apparent from the 
following detailed description taken with the accompa- 
nying drawings In which: 

Fig. 1 is a diagram schematically showing the entire 
structure of a diagnosis system In accordance with 
one embodiment of the present invention; 
Fig. 2 is a perspective view showing a use mode of 
a positioning implement 10 available in Imaging tyy 
a terminal of the diagnosis system shown in Fig. 1 ; 
Fig. 3 is a functional block diagram showing the 
structure of a terminal included in the diagnosis sys- 
tem shown in Fig. 1 ; 

Fig. 4 is a functional block diagram showing the 
structure of a server included in the diagnosis sys- 
tem shown in Fig. 1 ; 

Fig. 5 is a diagram showing an example of an image 



displayed on a display device of the tenriinal when 
oral consuttatran data is inputted to the terminal; 
Figs. 6A to 6C are diagrams showing examples of 
an image indicated by comparison image data used 
5 In a drooping eyelid diagnosis; 

Rg. 7 is a diagram for explaining an example of the 
contents of reference data used In the drooping 
eyelid diagnosis; 

Fig. 6 is a diagram for explaining an example of the 
contents of prescription reference data used in the 
drooping eyelid diagnosis; 
Fig. 9 is a diagram for explaining an example of the 
contents of reference data used in a depression di- 
agnosis (1); 

Fig. 1 0 is a diagram for explaining an example of 
the contents of the prescription reference data used 
In the depression diagnosis (1); 
Figs. 11 A to 11 C are graphs for explaining examples 
of the contents of the reference data used in a de- 
20 pression diagnosis (2), respectively; 

Rg. 12A and 12B are diagrams showing examples 
of an image indicated by comparison image data 
used in a hair diagnosis, respectively; 
Fig. 13 Is a diagram for expiajning an example of 
25 the contents of the reference data used In the hair 
diagnosis; 

Fig. 14 Is a diagram for explaining an example of 
the contents of the reference data used in the hair 
diagnosis; 

so Rg. 15 is a diagram showing an example of an im- 
age indicated by comparison image data used in a 
skin aspect diagnosis; and 
Rg. 16 is a diagram for explaining an example of 
the contents of the reference data used in the skin 
35 aspect diagnosis. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMSDOIMENTS 

^ [0052] Now, a description will be given in more detail 
of preferred embodiments of the present invention with 
reference to the accompanying drawings. 

(Entire Structure) 

45 

[0053] A diagnosis system embodied by this embod- 
iment is shown in Fig. 1 . 

[0054] The diagnosis system includes a terminal T as 
a terminal device of the present invention and a server 
so S as an Infomrtation processing device of the present 
Invention, and also includes a beauty goods shop B and 
a dnjgstore Y. Tltey are connected to each other through 
a networtc N made up of an internet or an Intranet. 



[0055] Then, the terminal Twill be descr&ed. The ter- 
minal T according to this emt>cdiment is made up of a 



50 



S5 (Structure Of terminal) 



15 



20 



25 



30 



6 



11 



EP1 169964 A2 



12 



home computer although the present Invention Is not 
limited to this. 

[0056] The term! nal T includes a given display device 
T1 , an Input device T2 made up of a keyboard, a mouse 
and so on for inputting oral consultation data which will 
be described later, and an Imaging device C made up 
of a digital camera and so on. 
[0057] The imaging device C corresponds to an Im- 
aging means of the present invention. The Imaging de- 
vice A is so designed as to produce image data by inv 
aging. The temtinal T can receive the above-described 
image data through an input tenmlnal connected with a 
cable that connects the terminal T and the imaging de- 
vice C. 

[0058] The imaging device C is so used to image a 
given position to be imaged which is a part of a user's 
body by plural times as will be described later. That is, 
the imaging device C is required to image the same po- 
sition to be Imaged at given time intervals by plural 
times. In order to image the same position to be imaged 
by plurality times, imaging can be conducted refening 
to the relative position to a characteristic portion of the 
body such as a mole, eyes or a nose. For example, a 
portion 5 mm right from a specific mole Is set as the po- 
sition to be Imaged and can continue to be imaged. 
[0059] If occasion demands in the case of Imaging, 
the imaging is repeated while not only the position but 
also the magnification of imaging is fixed. 
[0060] In order to image the same position to be im- 
aged, an implement for subserving the Imaging, for ex- 
ample, a headgear-shaped positioning implement 10 
shown in Fig, 2 can be employed. The positioning im- 
plement 10 is designed in such a manner that the user 
wears the positioning implement 1 0 on his head In a giv- 
en direction, and the imaging device C is fined to a given 
one of a large number of positioning apertures 12 de- 
fined In frames 11 each of which extends longitudinally 
and laterally, thereby being capable of positioning the 
camera to a specific position. The positioning implement 
1 0 may be fixed to a given portion of his face, for exam- 
ple, at three points. This malces It possible to more ac- 
curately position the imaging device C. The accurate po- 
sitioning nuiy be conducted by using the above subserv- 
ing Implement before the Imaging is conducted. 
[0061] The computer that serves as the temnlnal T in- 
cludes a disk drive. A recording medium MT made up 
of a CD-ROM or a DVD-ROM according to the present 
invention is inserted into the disk drive so as to read a 
program stored in the recording medium according to 
the present invention. The computer has the respective 
functions required for the terminal T of the present in- 
vention by installing the program of the present inven- 
tion through the above-described process. 
[0062] The recording medium MT in this embodiment 
Is distributed by a manager of the server S who manag- 
es this system, or the like although the present Invention 
is not limited to this. It is not always necessary that the 
above-described program Is installed in the computer 



through the network, but the program may be installed 
in the computer through a delivering process via the net- 
work. 

[0063] The program can provide the computer with a 
5 function as the temninal T of the present invention by its 

single unit, or may provide the computer with a function 

of the terminal T of the present Invention in cooperation 

with OS installed in the computer. 

[0064] With the execution of the above-described pro- 
10 gram, the CPU that is built in the terminal T of the 

present invention constitutes the foltowing functional 

blocks. 

[0065] That Is, as shown In Rg. 3, the terminal T is 
made up of ah image data receive section 11 0, an oral 

IS consultation data receive portion 1 20, a control section 
130 and a transmit/receive section 150. 
[0066] The image data receive section 110 receives 
given image data produced by imaging through the im- 
aging device C. In this embodinrrant. the image data re- 

^ ceive section 1 1 0 Is so designed as to receive the image 
data through the cable that connects the imaging device 
C and the temninal T. The image data receive section 
110 may be so designed as to receive the Image data 
produced In the imaging device C, and may be so struc- 

25 tured as to receive the Image data through a memory 
card or other external recording medium. 
[0067] The oral consultation data producing section 
120 produces the oral consultation data in response to 
an input that is conducted by the user through the input 

30 device. The oral consultation data, is directed to infor- 
mation related to the contents of the diagnosis and also 
includes character infonmiation. 
[0068] The oral consultation data can Include Infomna- 
tion related to, for example, the age, the sex and the 

35 subjective symptom of the user and information related 
to date when the image data has been produced (Imag- 
ing has been made), a life rhythm and a life pattern. That 
is, the oral consultation data can include any information 
necessary for the diagnosis if the infonnation is related 

40 to character data. Also, the oral consultation data can 
be appropriately changed in accordance with the kind 
of the diagnosis contents. For example, in the case 
where the skin aspect diagnosis is made, the oral con- 
sultation data can Include information related to the kind 

45 of cosmetics In use. 

[0069] The oral consultation data is generally inputted 
as the character Infonnation from the keyboard that con- 
stitutes the input device T. For example, the oral consul- 
tation data can be produced by freely hitting characters 

50 by the user. A function of supplying the format of the 
diagnosis to be conducted to the user is provided In the 
control section 130 fonmed by execution of the above- 
described program, and the use can input the oral con- 
sultation data in that fonnat. Also, the control section 

55 1 30 is provided with a function of displaying, In the dis- 
play device T1 , a plurality of options related to infonna- 
tion required at the time of conducting the subject diag- 
nosis. The oral consultation data Is Inputted by selecting 



7 



13 



EP1 169 964 A2 



14 



the options displayed on the display device T1 by the 
user. 

[0070] The control section 130 manages the above- 
described tmaga data receive section 110 and oral con- 
sultation data receive section 120 and a transmit/re* 
celve section 140 and a display device nnanaging sec- 
tion 150 which will be described iater 
[0071] For example, the control section 130 deter- 
mines the image data and the oral consuitation data to 
be transmitted from the transmit/receive section 140 on 
the basis of the input contents of the user, and an image 
displayed on the display device T1 . 
[0072] Also, the control section 1 30 has a function of 
produdngthe correspondence inf onmation which is data 
indicating that for which diagnosis the received image 
data Is on the basis of an input from the above-described 
input device T2 or the like and adding the correspond- 
ence Infomiation to the image data. 
[0073] The transmit/receive section 140 executes a 
communication between the terminal T and the nehworlc 
N. The transmit/receive section 140 is so designed as 
to transmit at least the image data (and added con^e- 
spondence infomiation) and the oral consultation data 
to the server S through the networlc N. 
[0074] In this embodiment, the transmit/receive sec- 
tion 140 is so designed as to receive the diagnosis data 
produced by the server S (both of diagnosis data and 
prescription data, or prescription data depending on the 
occasion) which will be described later from the server 
S through the network N. 

[0075] The display device managing section 1 50 is so 
designed as to produce display data for displaying a de- 
sired image on the display device T1 . The display device 
managing section 150 is so designed as to produce the 
display data under the management by the control sec- 
tion 130. 

(Structure of Server) 

[0076] Subsequently, the sen/er S will be described. 
I n this embodiment, the server S is made up of a general 
computer. 

[0077] ' The sender S includes a given display device 
and a given input device made up of a keyboard, a 
mouse and so on. 

[0078] The computer that serves as the server S in- 
cludes a disk drive. 

[0079] A recording medium MT made up of a 
CD-ROM or a DVD-ROM according to the present in- 
vention Is inserted into the disk drive so as to read a 
program stored In the recording medium according to 
the present invention. The computer has the respective 
functions required for the server S of the present inven- 
tion by installing the program of the preaent invention 
through the above-described process. 
[0080] The program can provide the computer with a 
function as the infomiation processing device of the 
present inventton by its single unit, or may provide the 



con^uter with a function of the Information processing 
device of the present invention in cooperation with OS 
installed in the computer. 

[0081 ] With the execution of the above-described pro- 
5 gram, the CPU built in the server S of the present inven- 
tion constitutes the following functional block. 
[0082] That is. as shown in Fig. 4, the server S in- 
cludes a transmit/receive section 210 and a diagnosis 
section 220. 

to [0083] The transmit/receive section 210 is so de- 
signed as to execute a communication between the ter- 
minal T and the network N. The transmit/receh/e section 
210 is 80 designed as to receive at least the image data 
and the oral consultation data from the terminal T 

f5 [0084] In this embodiment, the transmit/receive sec- 
tion 21 0 can transmit the diagnosis data (both of pre- 
scription data and diagnosis data, or prescription data 
depending on the occasion) to a beauty salon B. the 
drugstore Y or the terminal Y used by the user through 

^ the network N. The transmission of the prescription data 
to the beauty salon B, the drugstore Y or the temninal T 
is selectively conducted with respect to one or plural por- 
tions. 

[0085] The diagnosis section 220 has both functions 
25 of the diagnosing means and the prescribing means of 
the present Invention. The diagnosis section 220 con- 
ducts a given diagnosis on the basis of the above-de- 
scribed image data and oral consultation data whch 
have been received from the temninal T through the net- 
w work N , and produces the prescription data related to a 
prescription tiiat meets the diagnosis result. 
[0086] In more detail, the diagnosis section 220 in- 
cludes an Image processing sectbn 221 , a reference 
data recording section 222, a Judging section 223, a pre- 
33 scriptton reference data recording section 224, a data 
producing section 225 and a con'espondenoe judging 
section 226. 

[0087] The image processing section 221 corre- 
sponds to the image processing means of the present 
40 ~ invention, and has a function of producing correspond- 
ence image data by conducting a given image process 
on the image data. 

[0088] T>ie reference data recording section 222 cor- 
responds to a part of the reference data recording 

<5 means according to the present Invention, and records 
the reference data necessary for producing the prescrip- 
tion data. The reference data recording section 222 nnay 
record the reference data for conducting at least one dh 
agnosis. In this embodiment, the reference data record- 

50 ing section 222 records the reference data for a droop- 
ing eyelid diagnosis, a depression diagnosis, an Insom- 
nia diagnosis, an autonomic imbalance diagnosis, a skin 
aspect diagnosis and a hair diagnosis, and said Judging 
means conducts at least of the depression diagnosis. 

55 the insomnia diagnosis, the drooping eyelid diagnosis, 
the autonomic imbalance diagnosis, the skin aspect di- 
agnosis and the hair diagnosis. 
[0089] The judging section 223 functions as the judg- 
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ing means according to the present invention in coop- 
eration with a prescription data producing section 225 
which will be described later. The Judging section 223 
connpares the comparison Image data produced In the 
above-described image processing section 221 with the 
reference data that meets a desired diagnosis and pro- 
duces the diagnosis data related to the diagnosis result 
taking the above-described oral consultation data Into 
consideration. 

[0090] Also, data required in producing the prescrip- 
tion data on the basis of the above-described diagnosis 
data is recorded in the prescription reference data re- 
cording section 224. In this embodiment, the prescrip- 
tion data recording section 224 records data related to 
the prescriptions pertaining to the drooping eyelid diag- 
nosis, the depression diagnosis, the insomnia diagno- 
sis, the autonomic imbalance diagnosis, the sidn aspect 
diagnosis and the hair diagnosis as the prescription data 
therein although the present invention is not limited to 
this. 

[0091] The prescription data producing section 225 
conresponds to the prescribing means according to the 
present invention. The prescription data producing sec- 
tion 225 receives the above-described diagnosis data 
and reads appropriate data from the prescription refer- 
ence data recording section 225, to thereby produce the 
prescription data. The prescription data is data related 
to a prescription that meets the present status indicated 
by the diagnosis data, and includes, for example, an ad- 
vice for recovering the present health state, an advice 
for recovering the skin aspect or infomnation related to 
those advices. The prescription data includes the con- 
tents corresponding to the respective diagnoses. 
[0092] The conrespondence Judging section 226 ana- 
lyzes the correspondence information transmitted from 
the terminaJ T which Is added to the image data and de- 
termines a diagnosis to be conducted on the image data. 
In this embodiment, because the respective diagnoses 
of the drooping eyelid diagnosis, the depression diag- 
nosis, the insomnia diagnosis, the autonomk: imbalance 
diagnosis, the skin aspect diagnosis and the hair diag- 
nosis can be conducted, the conrespondence Judging 
section 226 detemtines which of those diagnoses 
should be conducted on the basis of the conrespond- 
ence Infomiation. The determlnatton is transmitted to 
the Image processing section 221 and the judging sec- 
tion 223. The image processing section 221 conducts 
an appropriate image process on the basis of the conre- 
spondence information, and the judging section 223 
Judges an appropriate diagnosis. 

(Flow of Producing Prescription Data) 

[0003] A flow of producing tiie prescription data will 
be described In each of the drooping eyelid diagnosis, 
the depression diagnosis, the insomnia diagnosis, the 
autonomic Imbalance diagnosis, the skin aspect diag- 
nosis and the hair diagnosis. In the respective descrip- 



tions of the depression diagnosis and the sutisequent 
diagnoses, duplicate portion of ttie description of the 
drooping eyelid diagnosis will be appropriately omitted. 

5 (Drooping Eyelkf Diagnosis) 

[0094] The drooping eyelid means that an eyelid 
hangs down due to the abnormality of an eyelid levator 
or the eyelid chorda which is a muscle that hangs the 

10 eyelid or the connection failure of the eyelid levator or 
the eyeiid chorda and a tarsal. The drooping eyelid ap- 
pears as various mental and physical disease symp- 
toms. Therefore, because the various diseases may be 
prevented by eariy detecting the drooping eyelid, the de- 

IS tectlon of the drooping eyelid Is very significant. 

[0095] The diagnosis of the drooping eyelid is con- 
ducted, for example, as follows. 
[0098] The user first inputs the declaration of his in- 
tention that he detemiines to be subjected to the droop- 
ing eyelid diagnosis through the Input device T2. As a 
result, the control section 140 produces correspond- 
ence information indicating that a diagnosis conducted 
on the basis of image data which will be Inputted later 
is the drooping eyelid diagnosis. 

25 [0097] Then , the user images his eyes by the Imaging 
device C and produces the image data related to the 
Image of his eyes. The image of his eyes is set within a 
constant range including the user* eyes. 
[0098] The terminal T receives the image data pro- 

30 duced by imaging the his eyes by the imaging device C 
by tiie image data receive section 1 1 0. The data is trans- 
mitted to the transmit/receive section through the control 
section 140. Also, the control section 140 adds the 
above-described con-espondence infomiation to the im- 

35 age data. 

[0099] The transmit/receive section 140 is controlled 
by the control section 130 In response to a user's de- 
mand which is inputted by the operation of the tenninal 
T, and transmits the Image data added with the corre- 
^ spondence information to the server S through the net- 
wojk N. 

[0100] As occasion demands, the user conducts the 
operation for inputting the oral consultation data includ- 
ing the character information through the input device 

^ T2, to thereby produce the oral consultation data. In this 
emlM>diment. in inputiing the oral consultation data, an 
image, for example, shown in Rg. 5 Is displayed in the 
display device T1 . The Image is displayed on the display 
device T1 on the basis of display data that is produced 

so by the display device managing section ISO under the 
control of the control section 130. 
[01 01] The user selects one option from options a and 
b (or a, b and c), for example, in examples (1 ) to (6). and 
inputs a document through a keyboard or the like In an 

S3 example (1 0), to thereby input the oral consultation data. 
In tiie case where the oral consultatk)n data has bean 
inputted, the terminal T receh^es the above-described 
oral consultation data through the oral consultation data 
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receive section 1 20. The data Is transmitted to the trans- 
mit/receive section through the control section 140. 
[0102] The transmit/receive section 1 40 is controlled 
by the control section 130 In response to the user's de- 
mand Inputted through the operation of the terminal T, 
and adds the oral oonsuttation data to the image data to 
transmit those data to the server S. 
[01 03] The server S receives the image data (or both 
of the image data and the oral consultation data) trans- 
mitted from the terminal T through the network N by the 
transmit/receive section 210, and conducts the diagno- 
sis as to the drooping eyelid diagnosis on the basis of 
the data. 

[0104] The Image data related to the eyes received 
from the transmit/receive section 210 Is transmitted to 
the diagnosing section 220. 

[0105] First, the correspondence Judging section 226 
analyzes the correspondence infomnation added with 
the Image data and determines that a diagnosis to be 
conducted on the basis of the transmitted image data is 
the drooping eyelid diagnosis on the basis of the corre- 
spondence information. This determination is transmit- 
ted to the image processing section 221 and the judging 
section 223 to ensure an appropriate process In the Im- 
age processing section 221 and an appropriate Judg- 
ment in the judging section 223. 
[0106] Also, the image data is transmitted to the Im- 
age processing section 221 . As occasion demands, the 
Image processing section 221 conducts a given image 
process on the inuge data to produce comparison Im- 
age data. 

[01 07] For example, a given threshold value of bright- 
ness is set to subject the Image to a binary or ternary 
coding, thereby being liable to conduct the subsequent 
judgment as to the Image of the eyes. Also, an edge 
emphasis or a contour line process due to moire may 
be conducted. 

[0106] Also, the image processing section 221 may 
conduct a color correction process. Since the image da- 
ta Is frequently different from the natural Image due to 
a difference In the specification between the imaging de- 
vices C or a difference in Illumination at the time of Im- 
aging, the color correction Is conducted, thereby being 
capable of conducting an accurate diagnosis. For ex- 
ample, a seal or the like on which a gh^en reference color 
is stuck at a given amangement Is distributed to the user 
in advance, and the user is obliged to stick the seal to 
an Imaging area to conduct imaging. Then, the refer- 
ence color within the seal which is reflected in the image 
is adjusted to a color which Is prepared In advance, and 
this process Is applied to the entire Image. The color cor- 
rection process may be conducted at the temninal T of 
the user side. In this case, the unified image data which 
has been subjected to the color correction is transmitted 
to the sen/er S. In this case, the tenminal T Is required 
to provide a means for conducting the color correction, 
for example, to provide a function of the above-de- 
scribed control section 1 30. 



[0109] In this embodiment, the image of the user's 
eyes is converted Into an Image of a diagram shown in 
Figs. 6A to 6C which definitely shows only the contour 
of the eyes, the boundary of the white and black (gray) 

5 of the eye. and the contour of p upli. to produce the com- 
parison image data related to the image. 
[0110] The comparison image data whch has been 
subjected to the above-described process as occasion 
demands is then transmitted to the Judging section 223. 
The Judging section 223 compares the comparison inn- 
age data with the ret erencedata read from the reference 
data recording section 222 to conduct a judgment on the 
basis of the comparison image data. This judgment cor- 
responds to the diagnosis made by the doctor. 

IS [0111] In the judgment, there Is used the reference 
data related to the drooping eyelid diagnosis recorded 
in the reference data recording section 222. The refer- 
ence data is not particularly restricted if it Is used to con- 
duct an appropriate Judgment as to the drooping eyelid. 

20 The reference data is, for example, shown in Fig. 7. 
[0112] The judging section 223 conducts the judg- 
ment by judging which reference of states 1 to 3 shown 
in Fig. 7 the image based on the comparison image data 
meets, and produces the diagnosis data. For example, 

25 n the eyelid is set within a range indicated by an arrow 
In fig, 6A, a judgment Is made that the Image meets the 
reference 1 corresponding to "nomnar, and In case of 
Fig. SB, a judgment is made that the image meets the 
reference 2 corresponding to 'slight drooping eyelid'. In 

30 case of Fig. 6C, a judgment is made that the image 
meets the reference 3 corresponding to 'serious droop- 
ing eyelkJ". The data related to those judgment results 
are diagnosis data. 

[0113] If the following contents are added to the com- 
as parison image data, the diagnosis can be more accu- 
rately produced on the basis of the Image. 
[01 1 4] That Is, In case of a user whose eyebrows are 
elevated, since it is hard that the symptom of the droop- 
ing eyelid is developed as compared with the nornial 
^ case, the presence/absence of the elevated eyebrows 
Is judged on the basis of the image of the eyebrows In 
addition to the above-described judgment based on the 
Image, thereby being capable of conducting a more ac- 
curate judgment as to the drooping eyelid. For example. 
45 if It is judged on the basis of the Image of the eyebrows 
that the eyebrows are elevated, the judgment that the 
drooping eyelid is slight on the basis of the Image of the 
eyes can be corrected to the judgment that the drooping 
eyelid is serious, or the judgment that the symptom is 
50 nomial on the basis of the image of the eyes can be 
con'ected to the Judgment that the symptom Is the slight 
drooping eyelid so far as It Is judged that the symptom 
is normal but close to the drooping eyelid. Such a cor- 
rection may be appropriately conducted as occasion de- 
95 mands. 

[01 1 5] If the oral consultation Is also transmitted, the 
above-described Judgment may be made taking the 
contents of the oral consultation data Into consideration 
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to produce the diagnosis data. For example, tn the case 
where the contents that user's sleeping hours are short 
on a preceding day are included in the oral consultation 
data, the diagnosis data can be produced taking the 
above contents Into consideration. 
[0116] If the judgment in the judging section 223 Is 
delicate, the judgment in the judging section 223 Is re- 
served 80 as to hand the Judgment to the doctor or an- 
other expert. In this case, the production of the following 
prescription data can be conducted by the doctor. 
[0117] The diagnosis data Is transmitted to the pre* 
scriptlon data producing section 225. The prescription 
data producing section 225 produces the prescription 
data on the basis of the diagnosis data. 
[0118] In the production of the prescription data, the 
prescription reference data related to the drooping eye- 
lid recorded in the prescription reference data recording 
section 224 Is used. The reference data is not particu- 
larly restricted if the reference data is used to conduct 
an appropriate and significant prescription for each of 
the drooping eyelid symptoms. An example of the refer- 
ence data Is shown in Fig. 8. 
[0119] That is, if the diagnosis data is 1 indicative of 
"normal", data 1 Indicating that no prescription is re- 
quired is produced. If the diagnosis data is 1 indicative 
of "normal", data 1 indicating that no prescription is re- 
quired is produced. If the diagnosis data is 2 indicative 
of "slight drooping eyelid", data 2 suggesting the dosage 
of a medicine A is produced. If the diagnosis data is 3 
indicative of "serious drooling eyelid', data 3 suggest- 
ing the dosage of a stronger medicine B. Those data 
becomes the prescription data. 
[01 20] In the case where the oral consultation data Is 
also transmitted, the above-described diagnosis data 
and prescription data are produced taking the contents 
of the interview prescription data into consideration. 
[0121] For example, in the case where the contents 
that user's sleeping hours are short on a preceding day 
are included in the orai consultation data, even if the 
eyelid is slightly drooped, such a symptom can be 
Judged as no disease, in particular, in the case where 
the sign of the drooping eyelid has not been found in the 
image data transmitted at the last two times, the droop- 
ing of the eyelid which is slightly developed can be 
judged as a short-period symptom that Is caused by the 
shortage of sleep on a preceding day. 
[0122] In the case where the oral consultation data Is 
taken into consideration in the production of the pre- 
scription data, if the contents indicating that the sleeping 
hours are short are included in the oral consultation da- 
ta, an instmctlon that sleeping hours should be in- 
creased as much as possible can be included In the pre- 
scription data. 

[0123] The diagnosis data and the prescription data 
are transmitted to the terminal T used by the user or the 
like from the server S for use. In other words, the user 
can grasp his health state on the basts of the diagnosis 
data or the prescription data, or purchase and take a 



medicine. As occasion demands, the user can be sub- 
jected to a diagnosis by the doctor anew. 
[0124] In this situation, the diagnosis data and the pre- 
scriptlon data are transmitted from the transmit^receive 

5 section 21 0 of the server S through tiie network N. The 
temninal T receives the diagnosis data and the prescrip- 
tion data at Its transmit/receive section 140. 
[0125] The diagnosis data and the prescription data 
can be utilized by delivering those data from the server 

10 s to the drugstore Y. For example, it is possible that the 
drugstore Y extracts a person who appeals to be anx- 
ious about his health on the basis of the diagnosis data, 
and send a direct mall to the person. Also, It is possible 
that the drugstore Y delivers the above-described med- 

19 idne A orB indk:ated by the prescription data to the user, 
or asks the user about his intention to purchase those 
medicines by a direct mail, by using the prescription da- 
ta. The utilization of the above diagnosis data and pre- 
scription data makes both of the user and the drugstore 

20 Y obtain advantages. 

[0126] In this situation, the delivery of the data to the 
drugstore Y can be conducted by transmitting the data 
from the transmlt/receive section 210 of the server S 
through the network N. In this case, the data can be re- 
^ ceived by a tenminal not shown which is located at the 
drugstore Y. Also, the delivery of the data may be con- 
ducted through some recording medium, or may be con- 
ducted by means of a paper medium printed out from 
the server S. 

30 [01 27] The above-described process is regulariy or ir- 
regulariy repeated, and the diagnosis data and the pre- 
scription data are produced at times for use by the user. 
If the circumstances of the user changes, the diagnosis 
data and the prescription data also change with a time, 

35 with the result that the worthy diagnosis data and pre- 
scription data which meet the state of the user are al- 
ways produced. 

[0126] In the above-described embodiment, an exam- 
ple in which the prescription data is also utilized Is de- 
40 scribed. However, if no prescription data is required, on- 
ly the diagnosis data may be employed. In this case, the 
prescription reference data recording section 224 and 
the prescription data producing section 225 within the 
server S are not required.. 

45 

(Depression Diagnosis (1)) 

[01 29] tn the case where the user is subjected to de- 
pression, there are many cases In which the above-de- 
so scribed drooping eyelid symptom Is developed. There- 
fore, the diagnosis of the depression can be perfonned 
by conducting substantially the same treatment as that 
in the drooping eyelid. 

[0130] In other words, if the depression diagnosis da- 
55 ta used when the judging section 223 produces the di- 
agnosis data as shown in Fig. 9 isprepared. the depres- 
sion diagnosis is conducted by execution of substantial- 
ly the same treatment as that in case of the drooping 
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eyelid diagnosis, tn this case, the diagnosis data Indic- 
ative of any one of the normal, the slight depression and 
the serious depression Is produced. In the case where 
the oral consultation data is also transmitted, the diag- 
nosis data is produced taking the oral consultation data 
into consideration as in the drooping eyelid diagnosis. 
[0131] The prescription data producing section 225 
produces the prescription data in accordance with the 
above-described diagnosis data. In this case, prescrip- 
tion reference data, for example, shown in Fig. 10 may 
be prepared. In this example, prescription data indica- 
tive of "No need for symptom". "Suggest the dosage of 
a medidne C" or "Suggest the. dosage of a medicine D 
and hospital visit" is produced. 
[0132] IHow to utilize the diagnosis data and the pre- 
scription data by the user and the drugstore is substan- 
tlally identical with that in the drooping eyelid diagnosis, 
and the above-described process can be regularly or ir- 
regularly repeated as in the drooping eyelid diagnosis. 

(Depression Diagnosis (2)) 

[01 33] In the case where the user is subjected to de- 
pression, there has been known that a reaction of his 
pupils to a light stimuli is characteristic. On the basis of 
this phenon^enon, the depression diagnosis can be ex- 
ecuted by a method different from the above method. 
[0134] Similarty, In this case, the user images his eyes 
by the imaging device C, but the image is a moving pic- 
ture. In other words, a light constant in intensity is inra- 
diated onto the eyes and thereafter a moving image in- 
dicative of a change in the diameter of the pupils In a 
given period of time is imaged. The Image of the eyes 
Is set within a constant range Including user's eyes. 
[0135] The image data thus produced is transmitted 
to the server S, as occasion demands, together with the 
oral consultation data. 

[01 36] The server S conducts the diagnosis of the de- 
pression on the basis of the image data (or both of the 
image data and the oral consultation data) transmitted 
from the ternunal T through the networtc N. 
[0137] The image data Is transmitted to the Image 
processing section 221 , and then subjected to, for ex- 
ample, e binary orternary coding in orderto make it easy 
to detect the area of the pupil, in this example, the same 
in^age processing as that in the drooping eyelid diagno- 
sis is conducted, to thereby produce the comparison Im- 
age data. 

[0138] Subsequently, the conrparison Image data is 
transmitted to the judging section 223. The judging sec- 
tion 223 compares the comparison image data with the 
reference data read from the reference data recording 
sedton 222. to thereby conduct a judgment on the basis 
of the comparison Innage data. 
[0130] In this example, the reference data is related 
to the reaction patterns of the pupils, for example, es 
Shown in Figs. 11 A to 11 C. 

[01 40] Figs. 1 1 A to 1 1 C show the reaction patterns of 



the pupils after a light has been irradiated onto the eyes. 
Fig. 1 1 A shows a reaction pattern of the pupil of a pereon 
who is in a normal condition. In case where he is in the 

normal condition, the pupil that is made small in size by 

5 irradiation of a light is quickly returned to an original size. 
Fig. 1 1 B shows a reaction pattern of the pupil of a person 
who is in an excessively strained condition. In case 
where he Is the excessively strained condition, the pupil 
that is made small in size by Iradlation of a tight, be- 

10 comes larger than the original size, and thereafter the 
pupil is repeatedly expanded and reduced without being 
not stabilized. Fig. 11C shows a reaction pattem of the 
pupil of a person who is subjected to depression. In the 
case where he is subjected to depression, the pupil that 

IS is made small in size by irradiation of a tight has a ten- 
dency to be hardly expanded, and also may not be fre- 
quently returned to the original size, repeatedly expand- 
ed and reduced without being not stabilized. 
[0141] The judging section 223 Judges to which pat- 

^ tern in Figs. 11A to 11C the comparison image data is 
similar, and on the basis of this result, judges whether 
the user is subjected to.depresslon or the like, in other 
words, If the comparison Image data is similar to the pat- 
tern of Fig. 11 A, diagnosis data indk:ating that the user 

25 Is in the nomnal condition is produced, if the comparison 
Image data is slmilarto the pattem of Fig. 11 B. diagnosis 
data Indteatlng that the user - Is In the excesshfely 
strained condition is produced, and if the comparison 
image data Is similar to the pattem of Fig. 1 1 C. diagnosis 

30 data Indicating that the user is subjected to depression 
is produced. 

[0142] The diagnosis data is transmitted to the pre- 
scription data producing section 225. The prescription 
data producing section 225 produces the prescription 

35 data on the basis of the diagnosis data. 

[0143] In the productton of the prescription data, the 
prescription reference data recorded in the prescription 
reference data recording section 224 is employed. An 
exanrtple of the prescription reference data is shown In 

40 Figs. 12A and 128. 

[0144] The prescription data produced in this example 
will be described. If the diagnosis data is data inducting 
the user is In a nomnal condition, data 1 indicative of "No 
need for symptom" is produced. If the diagnosis data is 

45 data indicating that the user is in an excessively strained 
condition, data 2 indicative of "Suggest the dosage of a 
medicine E and hospital visit" is produced. If the diag- 
nosis data is data indicating that the user Is subjected 
to depression, data 3 indicative of "Suggest the dosage 

50 of a medicine F and hospital visit" is produced. 

[0145] How to utilize the diagnosis data and the pre- 
scription data by the user and the drugstore is substan- 
tially identical with that In the drooping eyelid diagnosis, 
and the above-described process can be regulariy or Ir- 

S5 regulariy repeated as In the drooping eyelid diagnosis. 
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(Insomnia Diagnosis and Autonomic Inobalance 
Diagnosis) 

[0146] In the case where the user is subjected to in> 
somnia or autonomic imbalance diagnosis, there are 
many cases where the above-described drooping eyelid 
symptom is developed. Also, those diseases almost su- 
pervene depression. Therefore, the insomnia diagnosis 
and the autonomic imbalance diagnosis can be con- 
ducted by executing the same process as that In the 
above-described depression diagnosis. 
[0147] In case of the insomnia diagnosis, it is possible 
that diagnosis data is selectively produced from insom- 
nia, slight insomnia, serious insomnia and so on, and 
prescription data related to an appropriate prescription 
for the selected diagnosis data is produced. As exam- 
ples, prescription data Induding data related to a com- 
ment that suggests the dosage of an appropriate chem- 
ical agent or data related to a comment that suggests 
an exercise or a dietetic treatment may be produced. In 
order to achieve this process, the reference data and 
the prescription reference data may be so set as to pro- 
duce the above-described diagnosis data and prescrip- 
tion data. 

(Hair Diagnosis) 

[0148] People of both sexes has many worries about 
their hairs such as thin hair or the outgrowth of hair. 
Therefore, there is a great demand for the hair diagnosis 
which is easily conducted. 

[0149] The diagnosis of the hair health condition Is 
conducted by the following manner. In this example, a 
case in which the hair of user's head as the hair Is diag- 
nosed wilt be described. 

[0150] In the case of diagnosing the hair of user's 
head, the user Inputs infonnation for inputting con^e- 
spondence infonnation from the input device T2 or the 
like. Also, the user images the hair of his head by the 
imaging device C to produce image data related to the 
image of the hair of his head. The image of the hair of 
his head is set within a constant range of a given portion 
of the head sicln. In the case of imaging the given portion 
of the head skin, the positioning implement 1 D shown in 
Fig. 2 can be employed. The positioning implement Is 
employed in the above-described usage, to thereby sim- 
ply image the same position. 
[0151] Also, in this embodiment, the imaging of the 
hair of his head Is conducted by a predetermined mag- 
nifk^tion. 

[0152] The temnlnat T receives the image data pro- 
duced by imaging the hair of the head through the im- 
aging device C at the image data raceh/e sectk>n 110. 
The data is transmitted to the server S through the net- 
work N together with additional infonnation in response 
to a demand from the user 

[0153] As occasion demands, the user conducts op- 
eration for inputting oral consultation data Including 



character infonnation through the input device T2, to 
thereby produce the oral consultation data, in this situ- 
ation, in inputting the oral consultation data, an image 
that prompts the selection of s can be displayed in the 
s display device T1 as in the drooping eyelid diagnosis. 
In the case where the oral consultatton has been input- 
ted, the temninal T transmits the oral consultation data 
to the server S through the network N in addition to the 
image data. 

10 [01 54] The server S receives the image data (or both 
of the image data and the oral consultation data) trans- 
mitted from the terminal T by the transmit/receive sec- 
tion 21 0, end then diagnoses the hair of the head on the 
basis of that data. 

15 [01 55] As in the drooping eyelid diagnosis, the image 
data received by the transmit/receive section 210 is 
transmitted to the diagnosis section 220 to determine 
that the hair of the head is diagnosed by the correspond- 
ence Judging section 226, and the detennination is 

20 transmitted to the image processing section 221 and the 
judging section 223. 

[01 56] The image data of the hair of the head is trans- 
mitted to the image processing section 221 . As occasion 
demands, the image processing sectk}n 221 conducts 
^ a given image process on the image data to produce the 
comparison image data. 

[01 57] For example, a given threshold value of bright- 
ness is set to subject the image to a binary or ternary 
coding, thereby being liable to conduct the subsequent 

30 judgment as to the image of the eyes. In this embodi- 
ment, the image of the hair of user's head is binary-cod- 
ed.so as to definitely distinguish the hair of the head 
from other porttons. Rg. 12 shows an example of an en- 
larged image of the hair of the head displayed on the 

^ basis of the conrtparison image data. 

[0158] The comparison image data which has been 
subjected to the above-described process as occasion 
demands is then transmitted to the judging section 223. 
The judging section 223 compares the comparison Im- 

40 age data with the reference data read from the reference 
data recording section 222, to thereby conduct a Judg- 
ment on the basis of the comparison image data. 
[0159] In this judgment, there Is used the reference 
data related to the hair of the head recorded in the ref- 

43 erence data recording section 222. The reference data 
is not particularly restricted if an appropriate judgment 
of the hair of the head is conducted. An example of the 
reference data is shown in Figs. 13 and 14. 
[0160] The judging section 223 Judges which refer- 

50 ence shown in Figs. 1 3 and 1 4 the image shown in Fig. 
12A or 12B is similar to, to thereby produce the diagno- 
sis data. 

[0161] In an example shown in Fig. 13, "normal", 
"slight thin hair, or 'serious thin hair" is Judged accord- 
S5 ing to the number of the hair of the head with reference 
, to the number of the hairs of the head per a unit area. 
In the example shown in Fig. 14, the growth state of the 
hair of the head is judged according to the thickness of 
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the hair with reference to the mean thickness of the hair 
of the head. Specifically, "normal", 'slight poor growth" 
or "serious poor growth" is Judged. 
[0162] The data related to the judgment result such 
as "normal", "slight thin hair', "serious thin hair" or "nor- 
mal*, "slight poor growth" or "serious poor growth" be- 
comes diagnosis data. 

[0163] In the case where the oral consultation data 
has been also transmitted, the above-described Judg- 
ment is made taking the contents of the oral consultation 
data into consideration, to thereby produce the diagno- 
sis data. 

[0164] The diagnosis data is transmitted to the pre- 
scription data producing section 225. TTie prescription 
data producing section 225 produces the prescription 
data on the basis of the diagnosis data. 
[01 6S] In the production of the diagnosis data, the pre- 
scription reference data related to the hair of the head 
recorded in the prescription reference data recording 
sectk>n 224 is used. The reference data is not particu- 
larly restricted if an appropriate and significant prescrip- 
tion is conducted for each of the hair states. 
[01 66] For example, in the case where the diagnosis 
data is Indicative of "normal*, data indicating that no 
treatment Is required can be produced. In the case 
where the diagnosis data is indicative of "slight thin hair*, 
data that suggests the coating of some medicine or 
presents shampoo or hair conditioner to be used can be 
produced. In the case where the diagnosis data is indic- 
ative of "serious thin hair*, data that suggests the coat- 
ing of a stronger medicine or presents shampoo or hair 
conditioner to be used can be produced. Those data 
produced on the basis of the diagnosis data becomes 
the prescription data. 

[0167] In the case where the oral consultation data 
has been also transmitted, the above-described pre- 
scription data may be produced taking the contents of 
the oral consultation data into consideration. 
[0166] The diagnosis data and the prescription data 
are transmitted from the server S to the terminal T used 
by the user for use. The user can grasp his hair health 
condition on the basis of the diagnosis data. Also, the 
user can purchase an appropriate medicine, and pur- 
chase the shampoo or hair conditioner on the basis of 
the prescription data. 

[0169] Also, the prescription data can be delivered 
from the server S to the dojgstore Y. the beauty goods 
shop B or the tike for use. That is, the drugstore Y or the 
beauty goods shop B can conduct the same direct mail 
servk:e as that in the drooping eyelid diagnosis by using 
the diagnosis data or the prescription data. 
[01 70] The above-described process is regularly or Ir- 
regularty repeated to produce the prescription data at 
times, and the prescription data Is used by the user. 

(Skin Aspect Diagnosis) 

[0171] The diagnosis of the skin aspect health condi- 



tion is conducted, for example, as follows. In this exam- 
ple, a case of diagnosing the degree of skin dry as the 
skin aspect will be described. 
[0172] In the case of diagnosing the skin aspect, the 

s user images the skin aspect by the imaging device C to 
produce the image data related to the Image of the skin 
aspect. The Image of the skin aspect Is set within a con- 
stant range of a given portion of the skin. In the case of 
imaging the given portion of the skin, the positioning Im- 

fO plemant 1 0 shown in Fig. 2 can be employed! The po- 
8itk>ning irrplament 10 is employed in the above-de- 
scribed usage, to thereby easily image the same posi- 
tion. 

[01 73] Also, in this embodiment, the skin aspect is im- 

is aged by a predetennined magnff cation. 

[0174] The terminal T receives the image data pro- 
duced by imaging the skin aspect through the imaging 
devtee C by the Image data receive section 110. The 
data is transmitted through the network N in response 

^ to a demand from the user. 

[0175] As occasion demands, the user conducts the 
operation for inputting the oral consultation data includ- 
ing the character infomnation through the input device 
T2, to thereby produce the oral consultation data. In this 

ss situation. In inputting the oral consultation data, an Im- 
age that prompts the selection of options can be dis- 
played In the display devteeTI as in the drooping eyelid 
diagnosis. In the case where the oiral consultation has 
been inputted, the terminal T transmits the oral consul- 

30 tation data to the server S through the networic N in ad- 
dition to the image data. 

[01 76] The server S receives the image data (or both 
of the Image data and the oral consultation data) trans- 
mitted from the temnlnal T by the transmlt/receh^e sec- 
3S tion 21 0, and then diagnoses the hair of the head on the 
basis of that data. 

[01 77] As in the drooping eyelid diagnosis, the Image 
data received by the transmit/receive section 210 is 
transmitted to the diagnosis section 220 to determine 
40 that the skin aspect is diagnosed by the correspondence 
judging section 226. and the determination is transmit- 
ted to the image processing section 221 and the judging 
section 223. 

[01 78] The Image data of the skin Is transmitted to the 
<5 Image processing section 221 . As occasion demands, 
the image processing section 221 conducts a given im- 
age process on the image data to produce the compar- 
ison image data. 

[0179] In this example, a given threshokJ value of 
so brightness is set to subject the image to a binary coding, 
thereby being liable to conduct the subsequent judg- 
ment. Fig. 15 shows an example of an enlarged image 
of the skin indicated by the comparison image data, in 
Rg. 15. HM expressed as lines that extend lengthwise 
55 and breadthwise are grooves in the outer skin whk:h are 
called 'skin grooves', and the respective portions sec- 
tioned by the skin grooves HM are called 'skin hill HO'. 
[0180] The comparison image data which has been 
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subjected to the above-described process as occasion 
demands Is then transmitted to the Judging section 223. 
The judging section 223 compares the comparison im- 
age data with the reference data read from the reference 
data recording section 222. to thereby conduct a judg- 
ment on the basis of the comparison image data. 
[0181] in this Judgment, there is used the reference 
data related to the sicin aspect recorded in the reference 
data recording section 222. The reference data is not 
particutarly restricted if an appropriate judgment of the 
slcin aspect is conducted. The reference data is shown, 
for example, in Fig. 1 6 on the basis of the size of the 
sKm hiii HO. 

[01 82] The health sIcin grooves IHM extend lengthwise 
and beadthwise. However, the sIcin grooves HM of the 
bad health extends in only one direction, and the worse 
health skin has no sldn groove HM per se. That is. the 
skin is more delicate with more moisturized health skin, 
and an area of the skin hill HO becomes small. The 
above-described reference data is used to judge the de- 
gree of the skin dry on the basis of the above knowledge. 
[0183] The judging section 223 Judges which refer- 
ence shown in Fig. 16 the image shown in Fig. 15 on 
the basis of the comparison image data Is similar to, to 
thereby produce the diagnosis data. 
[0184] in an example shown in Fig. 1 6, "excellent skin 
condition*, "skin is aging" or "skin is aged" is Judged on 
the basts of the state of the skin groove HM or the size 
of the area of the skin hid HO. 
[0185] The conclusion of "excellent skin condition", 
"skin is aging" or "skin is aged" obtained as a result of 
the judgment becomes diagnosis data. 
[0166] In the case where the oral consultation data 
has been also transmitted, the above-described judg- 
ment is made taking the contents of the oral consultation 
data into consideration, to thereby produce the diagno- 
sis data. 

[0187] For exannpie, the appropriate size of the area 
of the skin hilt HO depends on age. Therefore, the judg- 
ment of "excellent skin condition", "skin is aging" or "skin 
is aged" Is corrected on the basis of the data of ages 
included in the oral consultation data, thereby being ca- 
pable of producing more accurate diagnosis data. 
[0188] The diagnosis data is transmitted to the pre- 
scription data producing section 225. The prescription 
data producing section 225 produces the prescription 
data on the basis of the diagnosis data. 
[01 89] In the production of the diagnosis data, the pre- 
scription reference data related to the skin aspect re- 
corded in the prescription reference data recording sec- 
tton 224 is used. The reference data is not particulariy 
restricted If an appropriate and significant prescription 
Is conducted for each of the skin aspects. 
[0190] For example, in the case where the diagnosis 
data is indicative of "excellent skin condition", data Indi- 
cating that a cosmetk; A should be used can be pro- 
duced. In the case where the diagnosis data Is indicative 
of "skin is aging", data indicating that a cosmetic B 



Should be used can be produced. In the case where the 
diagnosis data is indicative of "skin is aged", data Indi- 
cating that a cosmetic C should be used and including 
a conrvnent that proposes that a judgment should be 
5 made by an expert can be produced. Those data pro- 
duced on the basis of the diagnosis dale becomes the 
prescription data. 

[0191] in the case where the oral consultation data 
has been also transmitted, the above-described pre- 
10 scription data may be produced taking the contents of 

the oral consultation data into consideration. 
[0192] The diagnosis data and the prescription data 
are, for example, returned from the server S to the ter- 
minal T used by the user for use. That is. the user can 

19 determine a cosmetk: to be purchased, or can ask for a 
further judgment by the expert on the basis of the prer^ 
scription data. 

[0193] Also, the diagnosis data and the prescription 
data can be delivered from the sen/er S to the beauty 

20 goods shop B or the like for use. That is, the beauty 
goods shop B can conduct the same direct mall 8ervk:e 
as that in the drooping eyelid diagnosis or send an ap- 
propriate cosmetic by using the prescription data. 

[01 94] The above-described process is regulariy or ir- 

25 regulariy repeated to produce the prescription data at 
times, and the prescription data Is used by the user. 
[0195] As was described above, according to the 
present Invention, the user can be subjected to simple 
medical care or medcal treatment at any time not de- 

30 pending on the convenience of the doctor. Also, accord- 
ing to the present Inventton, since a fixed point is con- 
tinuously observed, a precision in the medical care or 
medical treatment is kept to a high level although the 
doctor is not required in principle. 

^ [0196] The foregoing description of the preferred em- 
bodiments of the Invention has been presented for pur- 
poses of Illustration and description. It is not Intended to 
be exhaustive or to limit the invention to the precise form 
disclosed, and modifications and variations are possible 

^ in light of the above teachings or may be acquired from 
practice of the invention. The embodiments were cho- 
sen and described In order to explain the principles of 
the invention and its practical application to enable one 
skilled in the art to utilize the invention in various em- 

^ bodiments and with various modifications as are suited 
to the particular use contemplated. It is intended that the 
scope of the invention be defined by the claims append- 
ed hereto, and their equh/alents. 

50 

Claims 

1 . A diagnosis system, comprising: 

55 a tenninal device that receives Image data ob- 

tained by imaging from a given Imaging means 
that repeatedly images a position to be Imaged 
which is located at a given position of a user's 
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body; and 4. 
an information processing device which is con- 
nectable to said terminal device through a net- 
work; 

5 

wherein said tenninal device includes a trans- 
mitting nr^eans for transmitting the image data pro- 
duced by imaging the position to be imaged by said 
in^ging means to said information processing de- 
vice through said network; io 

wherein said image processing device in- 
cludes a diagnosing means that conducts a given 
diagnosis on the basis of image data received from 
said tenninal and produces diagnosis data pertain- 
ing to a diagnosis result; and 

wherein said information processing device 
produces the diagnosis data in a time series man- 
ner on the basis of a plurality of image data pro- 
duced by imaging the positbn to be imaged at given 
time intenrals. ^ 5. 



A terminal devk:e which is connectable through a 
network to an image processing device having a di- 
agnosing means that conducts a given diagnosis on 
the basis of image data received through the net- 
work to produce diagnosis data pertaining to a di- 
agnosis result, said temiinal device comprising: 



25 



a transmitting means that receives, from a giv- 
en imaging means that repeatedly images a po- so 
sltion to be imaged which is located at a given 
position of a user' s body, the image data pro- 
duced by imaging the position to be imaged 
with the use of saM imaging means by the user 
to transmit the image data to the infomnation 35 
processing device through sakl network. 

A terminal device which is connectable through a 
network to an information processing device having 
a diagnosing means for conducting a given diagno- ^ 
sis on the basis of image data and oral consultation 
data pertaining to the diagnosis contents and In- 
cluding given character information which are re- 
ceived through the network to produce diagnosis 
data pertaining to a diagnosis rasutt on the basis of ^ 
the diagnosis result, said terminal device compris- 
ing: 

a transmitting means that receives, from a giv- 
en imaging means that repeatedly images a po- so 
sitlon to be In^aged which Is located at a given 
position of a user* s body, the image data pro- 
duced by Imaging the position to be imaged 
with the use of saki Imaging means by the user 
and the diagnosis data and transmits the image ^ 
data and the diagnosis data to the information 
processing device through said network. 



A method of transmitting diagnosis Infomnation 
which is executed by a terminal devce that is con- 
nectable through a network to an information 
processing devce having a diagnosing means that 
conducts a given diagnosis on the basis of image 
data received through the network to produce diag- 
nosis data pertaining to a diagnosis result, said 
method comprising the steps of: 

receiving image data produced, from a given 
imaging means that repeatedly images a posi- 
tion to be imaged which is located at a given 
position of a user's body, the image data pro- 
duced by imaging the position to be imaged 
with the use of said imaging means by the user; 
and 

transmitting the image data to the information 
processing device through the network. 

A method of transmitting diagnosis information 
whk;h is executed by a temninal device which la con- 
nectable through a network to an information 
processing device having a diagnosing means for 
conducting a given diagnosis on the basis of Image 
data and oral consultation data pertaining to the di- 
agnosis contents and including given character In- 
formation which are received through the network 
to produce diagnosis data pertaining to a diagnosis 
result, said method comprising the steps of: 

receiving Image data produced, from a given 
imaging means that repeatedly Images a posi- 
tion to be inuiged which is located at a given 
position of a user's body, the image data pro- 
duced by Imaging the position to be imaged 
with the use of said Imaging means by the user 
and the diagnosis data; and 
transmitting the inr^age data and the diagnosis 
data to the information processing device 
through the network. 

A recording medium that records, In a computer 
readable manner, a program for allowing a temnlnal 
devk:e with a computer which Is connectable 
through a network to an Information processing de- 
vice having a diagnosing means that conducts a 
given diagnosis on the basis of image data received 
through the network to produce diagnosis data per- 
taining to a diagnosis result to function as a trans- 
mitting device, said computer executing said pro* 
gram comprising the steps of: 

receiving data produced, from a given imaging 
means that repeatedly Images a position to be 
imaged which is located at a given position of 
a user's body, the image data produced by im- 
aging the position to be imaged with the use of 
said imaging means by the user; and 



16 



31 



EP1 169964 A2 



32 



transmitting the Image data to the infomiatlon 
processing device through the networlc. 

7. A recording medium that records, in a computer 
readable manner, a program for allowing a terminal 
device with a computer which is connectable 
through a network to an information processing de- 
vice having a diagnosing means for conducting a 
given diagnosis on the basis of image data and oral 
consultation data pertaining to the diagnosis con- 
tents and including given character information 
which are received through the network to produce 
diagnosis data pertaining to a diagnosis result to 
function as a transmitting device, said computer ex- 
ecuting said program comprising the steps of: 

receiving image data produced, from a given 
imaging means that repeatedly images a posi- 
tion to be imaged whfeh is located at a given 
position of a user's body, the image data pro- 
duced by innaging the (position to be imaged 
with the use of said imaging means by the user 
and the diagnosis data; and 
transmitting the image data and the diagnosis 
data to the information processing device 
through the network. 

8. A program recorded in a given recording medium in 
a computeir readable manner, for allowing a termi- 
nal device with a computer which is connectable 
through a network to an information processing de- 
vice having a diagnosing means that conducts a 
given diagnosis on the basis of image data received 
through the network to produce diagnosis data per- 
taining to a diagnosis result to function as a trans- 
mitting device, said computer executing said pro- 
gram comprising the steps of: 

receiving data produced, from a given imaging 
means that repeatedly images a position to be 
Imaged which Is located at a given position of 
a user's body, the image data produced by Im- 
aging the position to be Imaged with the use of 
said imaging means by the user; and 
transmitting the image data to the Information 
processing device through the network, 

9. A program recorded in a given recording medium in 
a computer readable manner, for allowing a termi- 
nal device with a computer which Is connectable 
through a network to an Information processing de- 
vice having a diagnosing means for conducting a 
given diagnosis on the basis of Image data and oral 
consultation data pertaining to the diagnosis con- 
tents and including gh^en character Information 
which are received through the network to produce 
diagnosis data pertaining to a diagnosis result to 
function as a transmitting device, said computer ex- 



ecuting said program oomprtsing the steps of: 

receiving image data produced, from a given 
imaging means that repeatedly inuiges a post- 

5 tion to be imaged which is located at a given 

position of a user's body, the image data pro- 
duced by imaging the position to be imaged 
with the use of said imaging means by the user 
and the diagnosis data; and 

10 transmitting the image data and the diagnosis 

data to the infomiation processing device 
through the network. 

10. An infomnation processing device that is connecta- 

1^ ble through a network to a terminal devk:e having a 
transmitting means that receives, from a given im- 
aging means that repeatedly images a positk>n to 
be imaged which is located at a given position of a 
user' s body, the Image data produced by imaging 

^ the position to be imaged with the use of said imag- 
ing means by the user to transmit the image data 
through said nehvork, saki information processing 
device connprislng: 

wherein said Image processing device In- 

25 eludes a diagnosing means that conducts a given 
diagnosis on the basis of image data received from 
said terminal and produces diagnosis data pertain- 
ing to a diagnosis result; and 

wherein said infonmation processing device 

30 produces the diagnosis data In a time series man- 
ner on the basis of a plurality of Image data pro- 
duced by imaging the position to be imaged at given 
time intervals. 

35 11. The information processing device as claimed in 
claim 10, wherein said diagnosing means compris- 
es: an image processing means for conducting a 
given image process on the image data to produce 
comparison image data; refererrce data recording 

40 means for recording reference data for diagnosis; 
and a judging means for comparing the comparison 
image data with the reference data to conduct the 
given diagnosis. 

^ 12. An information processing device which is connect- 
able through a network to a terminal device having 
a transmitting means that receives, from a given im- 
aging means that repeatedly images a position to 
be imaged which Is located at a given position of a 

50 user' s body, image data produced by imaging the 
posttton to be imaged by the user and oral consul- 
tation data pertaining to the diagnosis contents and 
including given character information and transmits 
the image data and the diagnosis data through said 

53 network, said infoimation processing device com- 
prising: 

a diagnosing means that conducts a given dl- 



17 



33 



EP1 169 964 A2 



34 



agnosia on the basis of the image data and the 
oral consultation data received from said temii- 
nal and produces diagnosis data pertaining to 
a diagnosis result; 

wherein said information processing device 
produces the diagnosis data in a time series man- 
ner on the basis of a plurality of image data and oral 
consultation data produced by imaging the position 
to be imaged at given time intervals. 

13. The infonnation processing device as ciaimed in 
claim 12. wherein said diagnosing means compris- 
es: an image processing means for conducting a 
given image process on the image data to produce 
comparison image data; reference data recording 
means for recording reference data for diagnosis; 
and a judging means for comparing the comparison 
image data and the oral consultation data with the 
reference data to conduct the given diagnosis. 

14. The information processing device as claimed in 
daim 11 or 13, wherein the reference data includes 
data for conducting at least one of a depression di- 
agnosis, an insomnia diagnosis, a drooping eyelid 
diagnosis, an autonomic irr^alance diagnosis, a 
skin aspect diagnosis and a hair diagnosis, and said 
Judging means conducts at least of the depression 
diagnosis, the insomnia diagnosis, the drooping 
eyelid diagnosis, the autonomic imbalance diagno- 
sis, the skin aspect diagnosis and the hair diagno- 
sis. 

15. The infonnation processing device as ciaimed In 
claim 11 or 13, wherein the reference data includes 
data necessary for conducting plural kinds of diag- 
noses; and 

wherein correspondence infonnation indtoa- 
tive of which diagnosis the Image con^esponds to Is 
added to the image data, and said judging means 
conducts the plural kinds of diagnoses indicated by 
the correspondence Information on the basis of the 
correspondence information received together with 
the image data. 

16. The information processing device as claimed in 
claim 15, 

wherein the reference data includes data for con- 
ducting at least one of a depression diagnosis, an 
Insomnia diagnosis, a drooping eyelid diagnosis, an 
autonomic imbalance diagnosis, a skin aspect di- 
agnosis arid a hair diagnosis, and 

wherein correspondence information jndca- 
tlve of which diagnosis the Image con'esponds to Is 
added to the image data, and said Judging means 
conducts any one of the depression diagnosis, the 
insomnia diagnosis, the drooping eyelid diagnosis, 
the autonomic imbalance diagnosis, the skin aspect 



diagnoala and the hair diagnosis Indicated by the 
correspondence infonnation on the baais of the cor- 
respondence Information received together with the 
Image data. 

5 

17. The infonnation processing device as claimed in 
claim 10 or 12, further comprising a prescribing 
means for producing prescription data pertaining to 
a prescription suitable for the diagnosis result; 
^0 wherein said prescribing means produces the 

prescription data in accordance with the time series 
on the basis of the diagnosis data produced in ac- 
cordance with the time series. 

IS 18. A method of producing diagnosis data which Is ex- 
ecuted by an infonmation processing device which 
is connectable through a network to a terminal de- 
vk:e having a transmitting means that receives, 
from a given imaging means that repeatedly images 

^ a position to be imaged which is located at a given 
position of a user* s body, the image data produced 
by imaging the position to be imaged by the user to 
transmit the image data through said network, said 
method oonriprtsing: 

25 

receiving the image data from said terminal; 
and 

conducting a given diagnosis on the basis of 
the image data to produce the diagnosis data 
30 pertaining to the diagnosis result on the basis 

of the diagnosis result; 

wherein said receiving step and sakj conduct- 
ing step are repeatedly conducted on a piurality of 
35 image data produced by imaging the position to be 
imaged at given time intervals by the user to pro- 
duce the diagnosis data In accordance with the time 
series. 

40 19. A method of producing diagnosis data which is ex- 
ecuted by an infonnation processing device which 
is connectable through a network to a tenninal de- 
vice having a transmitting means that receives, 
from a given imaging means that repeatedly images 

^ a position to be imaged which is lcx:ated at a given 
posttksn of a user* s body, the image data produced 
by imaging the positbn to be imaged by the user 
and oral consultation data pertaining to the diagno- 
sis contents and including given character Informa- 

so tion to transmit the image data and the oral consul- 
tation data through said networic, said method com- 
prising: 

receiving the image data and the oral consulta- 
55 tion data from said temninal; and 

conducting a given diagnosis on the basis of 
the image data and the oral consultation data 
to produce the diagnosis data pertaining to the 
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diagnosis result on the basis of the diagnosis 
result; 

wherein said receiving step and said conduct* 
ing step are repeatedly conducted on a plurality of . 
image data produced by imaging the position to be 
imaged at given time Intervals and the oral consul- 
tation data by the user to produce the diagnosis da- 
ta in accordance with the time series. 

10 

20. A recording medium that records, in a computer 
readable manner, a program for allowing an infor- 
mation processing device with a computer which is 
connectable through a network to a terminal device 
having a transmitting means that receives, from a 
given imaging means that repeatedly Images a po- 
sition to t>e Imaged which is located at a given po- 
sition of a user s body, the image data produced by 
imaging the position to be imaged with the use of 
said imaging means by the user to transmit the im- ^ 
age data through said network to (unction as a di- 
agnosis data producing device, said computer ex- 
ecuting said program comprising the steps of: 

receiving the Image data from said tenninal; ^9 
and 

conducting a given diagnosis on the basis of 
the image data and the oral consultation data 
to produce the diagnosis data pertaining to the 
diagnosis result; 30 

wherein said receiving step and said conduct- 
ing step are repeatedly conducted on a plurality of 
image data produced by imaging the position to be 
imaged at given time Intervals to produce the plu- ^ 
rality of diagnosis data in accordance with the time 
. series. 

21. A recording medium that records, in a computer 
readable manner, a program for allowing an infer- 
mation processing device with a computer which is 
connectable through a network to a terminal device 
having a transmitting means that receives, from a 
given Imaging means that repeatedly Images a po- 
sition to be imaged which is located at a given po- ^ 
sition of a user s body, the image data produced by 
imaging the position to be imaged with the use of 
said imaging means by the user and oral consulta- 
tion data pertaining to the diagnosis contents and 
including given character information to transmit the so 
image data through said network to function as a 
diagnosis data producing device, said computer ex- 
ecuting said program comprising the steps of: 

receiving the image data and the oral consulta- ss 
tion data from said tennlnai; and 
conducting a given diagnosis on the basis of 
the Image data and the oral consultation data 



to produce the diagnosis data pertaining to the 
diagnosis result; 

wherein said receiving step and said conduct- 
ing step are repeatedly conducted on a plurality of 
image data produced by imaging the position to be 
imaged at given time intervals and the oral consul- 
tatton data to produce the plurality of diagnosis data 
in accordance with the time series. 

22. A program recorded in a recording medium in a 
computer readable manner, for allowing an informa- 
tion processing device with a computer which is 
connectable through a network to a temnlnal device 
having a transmitting means that receives, from a 
given imaging means that repeatedly images a po- 
sition to be Imaged which is located at a given po- 
sition of a user s body, the Image data produced by 
imaging the position to be imaged with the use of 
said imaging means by the user to transmit the im- 
age data through said network to functton as a di- 
agnosis data producing device, said computer ex- 
ecuting sakl program comprising the steps of: 

receiving the Image data from said ternilnal; 
and 

conducting a given diagnosis on the t>a5is of 
the Image data and the oral consultation data 
to produce the diagnosis data pertaining to the 
diagnosis result; 

wherein said receiving step and saki conduct- 
ing step are repeatedly conducted on a plurality of 
image data produced by Imaging the position to be 
imaged at given time intervals to produce the plu- 
rality of diagnosis data In accordance with the time 
series. 

23. A program recording in a recording medium in a 
computer readable manner, for allowing an infomia- 
tion processing device with a computer which is 
connectable through a network to a temilna) device 
having a transmitting means that receh/es, from a 
given imaging means that repeatedly images a po- 
sition to be Imaged which is located at a given po- 
sltton of a user* s body, the image data produced by 
imaging the position to be imaged with the use of 
said imaging means by the user and oral consulta- 
tion data pertaining lo the diagnosis contents and 
including given character infomiation to transmit the 
Image data through said network to function as a 
diagnosis data producing devk:e, said computer ex- 
ecuting said program comprising the steps of: 

receiving the image data and the oral consulta- 
tion data from said terminal; and 
conducting a given diagnosis on the basis of 
the image data and the oral consultation data 
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to produce the diagnosis data pertaining to the 
diagnosis result; 

wherein said receiving step and said conduct- 
ing step are repeatedly conducted on a plurality of 5 
image data produced by inuiging the position to be 
imaged at given time Intarvais and the oral consul- 
tation data to produce the plurality of diagnosis data 
In accordance with the time series. 
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FIG. 5 



ORAL CONSULTATION DATA INPUT CARD 

1. SEX? 
a . MALE b . FEMALE 

2. AGE? 
a . 20~39 b . 40-59 c . OVER 60 

3. DID YOU DO THE WASTE OF CONDITION WITHIN ONE MONTH ? 
a . YES b .NO 

4. DID YOU SUFFER FROM ILLNESS OF AN EYE WITHIN ONE MONTH ? 
a. YES b. NO 

5. HOW MUCH ARE YOUR SLEEPING HOURS OF YESTERDAY ? 

a . 7-8 HOURS b . 5-6 HOURS c , SHORTER THEN 5 

6. DOESNT FEELING BECOME BAD, AS FOR YOU ? 
a . YES b .NO 



10. OTHERS ( PLEASE WRITE HERE THAT IT IS 
WORRISOME ) 
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26 



EP1 168 964 A2 



< 
O 
LU 
O 

z 

UJ 

cr 

UJ 

u. 
ui 



Q. 
D 
Q. 

< 
U. 

O 

Ui 



< 
o 
z 

z> 

s 

UJ 



□ o 

UJ H 
>- O 

Ui UJ 
0) 
QC 
UI 



z 
< 

u. 

o 

Ui 

z 



o 
_ z 

> Ui 

z 
o 

CD 
UJ 



< 

cr 
o 
z 



1^ 

<Q 
Old 
ICC 

Qui 
-II 

Uih- 

hi 

UJ. 

zo 

□ UJ 

<k i» ^ 
O^UI 

z-> 

DZUi 
0<uj 

CDujI 
uj>^- 



UJ 

>- 

UJ 

o 
z 

Q. 



Ui 

> 

Ui 
Ui 

I 

> 
CD 

Z 
UJ 
D 
O 

X 

CO 



UJ 

>- 

UJ 

o 
z 



i -8 i-i 



GC 

-J 
CO 



D 

< 

U. 

o 

X 
UJ 

Z 
UJ 

o 

Ui 



X 
Q 

CO 

g 
oc 

UJ 

CO 



CM 



27 



EP1 169 964 A2 



FIG. 8 



PRESCRIPTION REFERENCE DATA 

1 . CASE 1 

i 

NO NEED FOR TREATMENT 

2 . CASE 2 

I 

RECOMMEND RECIPE OF MEDICINE A 

3. CASE 3 

i 

RECOMMEND RECIPE OF MEDICINE B 
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FIG. 9 

REFERENCE DATA 



1 . THE BOUNDARY LINE OF AN EYELID AND THE BOUNDARY LINE OF 

A PUPIL HAVE NO INTERSECTION 

I 

NORMAL 

2 . THE BOUNDARY LINE OF AN EYELID AND THE BOUNDARY LINE OF 

A PUPIL HAVE AN INTERSECTION, AND THE CENTER OF A PUPIL IS 
NOT HIDDEN BY THE EYELID 

I 

SLIGHT DEPRESSION 



3 . THE CENTER OF A PUPIL IS HIDDEN BY THE EYELID 

i 

SERIOUS DEPRESSION 
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FIG. 10 

PRESCRIPTION REFERENCE DATA 

1 . CASE 1 

i 

NO NEED FOR TREATMENT 

2 . CASE 2 

i 

RECOMMEND RECIPE OF MEDICINE C 

3. CASES 

i 

RECOMMEND RECIPE OF MEDICINE D 
AND HOSPITAL VISIT 
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FIG. 11A 




FIG. 11B 
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FIG. 11G 



TIME 




TIME 
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FIG. 12A 




FIG. 12B 
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FIG. 13 

REFERENCE DATA 

1 . THE NUMBER OF HAIRS PER UNIT AREA IS 20 OR MORE 

i 

NORMAL 

2 . THE NUMBER OF HAIRS PER UNIT AREA IS 9 TO 19 

i 

SUGHT THIN HAIR 

3 . THE NUMBER OF HAIRS PER UNIT AREA IS 8 OR LESS 

i 

SERIOUS THIN HAIR 



FIG. 14 

REFERENCE DATA 
1 . THE MEAN THICKNESS OF HAIRS IS 30//m OR MORE 

i 

NORMAL 

2 . THE MEAN THICKNESS OF HAIRS IS 1 0 TO 30 m 

\ 

SUGHT POOR GROWTH 

3. THE MEAN THICKNESS OF HAIRS IS 10 /im OR LESS 

. i 

SERIOUS POOR GROWTH 
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FIG. 15 
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FIG. 16 



REFERENCE DATA 

1 . THE MEAN AREA OF SKIN HILL IS 0.1mm? OR LESS 
(IT IS FOUND THAT SKIN GROOVES ARE CLEARLY 
MESH- SHAPED) ^ 

EXCELLENT SKIN CONDITION 



1 . THE MEAN AREA OF SKIN HILL IS 0.1 TO 1 .Omm^ 
(IT IS FOUND THAT SKIN GROOVES ARE UNCLEARLY 
MESH- SHAPED) ; 

SKIN IS SLIGHT DRIED 



1 . THE MEAN AREA OF SKIN HILL IS 1 .0mm2 OR MORE 
(SKIN GROOVES AND SKIN HILLS ARE NOT FOUND) 

i 

SKIN IS DRIED 
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